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ABSTRACT. This paper is a survey based upon the talk at the sateUite confer- 
ence to ECM 2012, "QQQ Algebra, Geometry, Information", Tallinn, July 9-12, 
2012. It is dedicated to the analogy between the notions of complexity in theoret- 
ical computer science and energy in physics. This analogy is not metaphorical: I 
describe three precise mathematical contexts, suggested recently, in which math- 
ematics related to (un)computability is inspired by and to a degree reproduces 
formalisms of statistical physics and quantum field theory. 
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0. Introduction and summary 

This survey of several recent papers ([Man2], [Man4]-[Man7], [ManMar]) is dedi- 
cated to a deep analogy between the notions of complexity in theoretical computer 
science and energy in physics. 

The analogy is not metaphorical: we describe several precise mathematical con- 
texts, suggested recently, in which mathematics related to (un) computability is 
inspired by (and to a degree reproduces) formalisms of statistical physics and quan- 
tum fleld theory. 



^Talk at the satellite conference to ECM 2012, "QQQ Algebra, Geometry, Information" 
Tallinn, July 9-12, 2012. 
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Namely, after recalling basics of the classical computability theory in sec. 1, we 
turn to three main subjects: 

a) The problem of (un)com,putahility of the asymptotic hound for error-correcting 
codes over a fixed finite alphabet (sec. 2). 

Here M. MarcoUi and the author have shown (in [ManMar] based upon [Man2]) 
that the asymptotic bound arises as a phase transition curve between different 
thermodynamic phases. The relevant partition function is a sum over the ensemble 
of all codes in which the role of energy is played by the Kolmogorov complexity of 
the code. 

b) The problem of mathematical foundation for the empirical Zipf's law (describ- 
ing e. g. the frequency distributions of words in natural languages). 

It was suggested that this distribution reflects minimization of certain "effort" . 
I show that (in certain contexts) if this effort is defined as complexity, Zipf's law 
emerges from L. Levin's a priori distributions, mathematical theory of which was 
founded in the 1970's: see sec. 3 and more detailed argumentation in [Man?]. 

c) The problem of uncomputable in the computability theory (sec. 4--6). 

It is well-known that the theory of computability unavoidably leads to effects 
of uncomput ability in its own realm: basically, it may be impossible to decide in 
finite time whether a partial recursive function is defined at a given point. 

I draw an analogy between this and problems of infinities in perturbative Quan- 
tum Field Theory. Moreover, I suggest that renormalization schemes from QFT 
involving first a deformation of the problem and then "subtraction of infinities" 
can be fruitfully applied in computation theory. This procedure as well involves 
Kolmogorov complexity. The basic common elements of the two formalisms are 
graphs appearing as Fcynman diagrams in QFT and as flowcharts in computation 
theory. For more details ad related results cf. [Man4], [Man5] and [Man3]. 

There is no proofs in this report: we focus on the presentation of basic ideas. 

1. A brief guide to computability: 
operadic and categorical perspective 

Any single approach to mathematical notion of computability - Turing's ma- 
chines. Church's lambda calculus, Markov's algorithms - by necessity bypasses rich 
intuitions governing other approaches. But since this is unavoidable, and since 
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our goal here is to pave the shortest way to Kolmogorov's complexity, for us com- 
putability theory here will be based on the theory of (partial) recursive functions. 

1.1. Three descriptions of partial recursive functions. A "function", 
say, / : X ^ Y, below always means a pair {f,D{f)), where D{f) C X and 
/ : D{f) — > y a set-theoretic map. The definition domain is not always mentioned 
explicitly. If D{f) — X, the function might be called "total"; generally it may be 
called "partial" one. The other extremal case is that of "empty function", with 
D{f) = 0. We put Z+ := {1, 2, 3, . . . }. 

(i) Intuitive description. A function / : — > Z" is (partial) recursive iff it is 
"semi-computable" in the following sense: there exists an algorithm F accepting 
as inputs vectors x = {xi, . . . , Xm) £ Z_|_ with the following properties: 

- if x e D{f), F produces as output f{x). 

- if X ^ D{f), F either produces the output "NO", or works indefinitely long 
without producing any output. 

(a) Formal description (sketch). It starts with two lists: 

- An explicit list of "obviously" semi-computable basic functions such as con- 
stant functions, projections onto i-th coordinate etc. 

- An explicit list of elementary operations, performed over functions, such as 
composition, inductive definition, and implicit definition by equation, that can be 
applied to several semi-computable functions and "obviously" produces from them 
a new semi-computable function. 

After that, the set of partial recursive functions is defined as the minimal set of 
functions / : , with all m, n > 0, containing all basic functions and closed 

wrt all elementary operations. For details, sec e. g. [Manl], Ch. V. 

(Hi) Diophantine description (a difficult theorem). A function / : Z" is 

partial recursive iff there is a polynomial 

P{xi, ...,Xm;yi,---,yn;ti,..., tq) e Z[x, y, t] 

such that the graph 

:={{x,f{x))}cZ^xZl 

is the projection of the subset P = in Z"^ x Z!Ji x Z^. For references and a proof, 
see e. g [Manl], Ch. VI. 
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1.2. Constructive worlds. An (infinite) constructive world is a countable set 
X (usually of some finite Bourbaki structures, such as the set of all error-correcting 
codes in a fixed alphabet, cf. sec. 2.1 below) given together with a class of structural 
numberings: intuitively computable bijections u : Z_j_ — )■ X which form a principal 
homogeneous space over the group of totally recursive permutations of Z+. A finite 
constructive world is any finite set. 

Categorical Church's thesis, Part I. Let X, Y be two infinite constructive worlds, 
vx '• Z+ X vy '■ Z+ — > X their structural numberings, and F an (intuitive) 
algorithm that takes as input an object x E X and produces an object F{x) E Y 
whenever x lies in the domain of definition of F; otherwise it outputs "NO" or 
works indefinitely. 

Then f := o F o vx '■ Z_|_ — > Z_|_ is a partial recursive function. 

Categorical Church's thesis, Part 11. Let C be a category, whose objects are 
some infinite constructive worlds, and some finite constructive worlds of all finite 
cardinalities. Define the set of morphisms C(X, Y) to be the set partial maps that 
can be algorithmically computed. 

Then C is equivalent to the category having one infinite object Z+, one finite 
object {!,...,} of each cardinality, and partial recursive functions as morphisms. 
If X is finite, then C{X, Y) consists of all partial maps. 

1.3. Kolmogorov complexity and Kolmogorov order. Let X be a con- 
structive world. For any (scmi)-computable function u : Z_|_ X, the (exponen- 
tial) complexity of an object x E X relative to u is 

Ku{x) := min{m G Z+ | u{m) = x}. 

If such m does not exist, we put Ku{x) = oo. 

Claim: there exists such u ("an optimal Kolmogorov numbering", or "decom- 
pressor") that for each other v : Z_|_ X, some constant Cu,v > 0, and all x E X, 

Ku{x) < Cu,vKy{x). 

This Ku{x) is called Kolmogorov complexity of x. 

A Kolmogorov order of a constructive world X is a bijection K = K^j : X Z^, 
arranging elements of X in the increasing order of their complexities ■ 
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Notice that any optimal numbering is only partial function, and its definition 
domain is not decidable. Moreover, the Kolmogorov complexity Ky^ itself is not 
computable: it is the lower bound of a sequence of computable functions. 

The same can be said about the Kolmogorov order. Moreover, on Z+ it cardinally 
difi'ers from the natural order in the following sense: it puts in the initial segments 
very large numbers that can be at the same time Kolmogorov simple. For example, 

n 

let ttn := n"^ (n times). Then Ku{an) < cn for some c > 0. 

In sec. 3 below we will discuss other remarkable properties of complexity, in 
particular, its self-similar fractal properties. 

Finally, the indeterminacy of the complexity related to different choices of op- 
timal functions u,v is multiplicatively exp(0(l)). The same is true for the Kol- 
mogorov order. 

For a thorough treatment of Kolmogorov complexity, cf. [LiVi] . Notice that in 
the literature one often uses the logarithmic Kolmogorov complexity which is defined 
as the length of the binary presentation of K^ix). It is interpreted as the length of 
the maximally compressed description of x. For our purposes, exponential version 
is more convenient, in particular, because it allows us to define an unambiguous 
Kolmogorov order on Z_|_ or any infinite constructive world. 

1.4. Oracle assisted computations. The formal description of partial recur- 
sive functions in sec. 1.1 (ii) allows one to define larger classes of partial functions 
that can be obtained by oracle assisted computations. The point is that the stan- 
dard elementary operations can be applied to arbitrary partial functions. Therefore 
we can add any uncomputable (not partial recursive) functions to the list of ba- 
sic functions and consider the minimal subset of partial functions containing this 
expanded list and closed wrt elementary operations. 

This option was used in [Man7] in order to define the respective extensions of 
the notion of complexity and apply them to the explanation of Zipf 's law in the 
situations, related to oracle assisted computations and library reuse, cf. sec. 3 
below. 

Formally, we are considering the (pro)perad generated by the elementary oper- 
ations on partial functions and various algebras over it. It would be important to 
understand all relations between elementary operations. For the first steps in this 
direction, cf. [Ya]; for a general formalism, cf. [BoMan]. 
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2. Error— correcting codes and their asymptotic bounds 

2.1. Basic notation. Choose an alphabet A, a finite set of cardinahty q > 2. 
A code C C A" is a subset of words of length n. Hamming distance between two 
words of the same length is defined as 

d{{ai), (bi)) := card{i e (1, . . . , n) | 7^ h}. 

Code parameters are the cardinality of the alphabet q and the numbers n(C), k{C), d{C) 
defined by: 

n{C) := n, k{C) := k := [loggCard(C)], 
d{C) := d = min {(i(a, b)\a,b E C,a b}. 
Briefiy, C is an [n, k, d]q-code. Its code point is the point 

Coordinates of x{C) = {R{C), S{C)) are called transmission rate and relative dis- 
tance respectively. 

The idealized scheme of using error-correcting codes for information transmis- 
sion can be described as follows. Some source data are encoded by a sequence of 
code words. After transmission through a noisy channel at the receiving end we 
will get a sequence of possibly corrupted words. If we know probability of corrup- 
tion of a single letter, we can calculate, how many corrupted letters in a word we 
may allow for safe transmission; pairs of code words must be then separated by a 
larger Hamming distance. This necessity puts an upper bound on the achievable 
transmission rate. 

A good code must maximize minimal relative distance when the transmission rate 
is chosen. 

Our discussion up to now was restricted to unstructured codes: arbitrary subsets 
of words. Arguably, one more property of good codes is the existence of efficient 

algorithms of encoding and decoding. This can be achieved by introduction of 
structured codes. A typical choice is represented by linear codes: for them, A is a 
finite field of q elements, and C is a linear subspace of . 

2.2. Asymptotic bound. Call the multiplicity of a code point the number of 
codes that project onto it. 
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2.2.1. Theorem. (Yu. M., 1981 + 2011). There exists a continuous function 
aq{S), S e [0, 1], with the following properties: 

(i) The set of code points of infinite multiplicity is exactly the set of rational 
points {R, S) e [0, 1]^ satisfying R < aq{S). 

The curve R = aq{S) is called the asymptotic bound. 

(a) Code points x of finite multiplicity all lie strictly above the asymptotic bound 
and are called isolated ones: for each such point there is an open neighborhood 
containing x as the only code point. 

(Hi) The same statements are true for linear codes, with a possibly different 
asymptotic hound R = a''^'^{d). 

2.3. Can one compute an asymptotic bound? During the thirty years 
since the discovery of the asymptotic bounds, many upper and lower estimates were 
estabhshed for them, especiaUy for the hnear case: see the monograph [VlaNoTsfa] . 
Upper bounds helped to pinpoint a number of isolated codes. 

However, the following most natural problems remain unsolved: 

- To find an explicit formula for ctg or ctg". 

- To find any single value of aq{5) or aq'^{5) for < 5 < 1 — (at the end 
segment [1 — q~^, 1] these function vanish). 

- To find any method of approximate computation of aq{5) or aq'^{S). 

- Clearly, ct^" < ctg. Is this inequaliy strict somewhere? 

2.4. A brief survey of some known results, (i) One can count the number 
of codes of bounded block length n and plot their code points. The standard 
probabilistic methods then give the following Gilbert-Varshamov bounds. 

Most unstructured g-ary codes lie lower or only slightly above the Hamming 
curve 

R=l-Hq{6/2), 

Hq{5) = Slog^iq - 1) - Slog^S - (1 - 5)log^(l - 5). 

Most linear q-eivy codes lie near or only slightly above the Gilbert-Varshamov 
bound 

R^l-Hq{5). 



8 



In particular, 

(ii) A useful combinatorial upper estimate is the Singleton bound: 

1 



i?(C) + 5(C) < 1 + 



n(C) 
Hence 

aq{5) <l-5. 

It follows that code points lying above this bound are isolated. The following 
Reed-Solomon (linear) codes C C belong to this group. 

Choose parameters 1 < k<n<q,d = n + l — k. Choose pairwise distinct 
xi,. . . ,Xn G Fq, Embed the space of polynomials /(x) e Fq[x] of degree < k — 1 
into Fg by 

/^(/(xi),...,/(:r„))eF^. 

After works of Goppa, this construction was generalized. Points xi,...,Xn G 
Fq were replaced by rational points of any smooth algebraic curve over F^, and 
polynomials by sections of an invertible sheaf. This allowed one to construct non- 
isolated linear codes lying partly strictly above the Gilbert-Varshamov bound. 

This implies that we cannot "see" the asymptotic bound, plotting the set of 
(linear) code points of bounded size: we will see a cloud of points, whose upper 
bound concentrates near the Hamming or Varshamov-Gilbert bounds. 

2.5. Partition function for codes involving complexity. The situation 

drastically changes, at least theoretically, if we allow ourselves to rearrange the 
codes in the order of growing Kolmogorov complexity. 

In order to state our principal theorem, notice that the function aq{6) is con- 
tinuous and strictly decreasing for 5 e [1,1 — Q~^)- Hence the limit points domain 
R < aq{5) can be equally well described by the inequality 5 < /3q{R) where /3q is 
the function inverse to cng. 

Fix an e Q n (0, 1). For A e Q n (0, 1), put 

Z(i?,A;/3):= J] K^{Cr^+'^^^-\ 

C: R{C)=R, A<S{C)<1 
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where Ku is an (exponential) Kolmogorov complexity on the constructive world of 
all codes in a given alphabet of cardinality q. 

2.6. Theorem, (i) If A > Pq{R), then Z{R, A; /5) is a real analytic function of 

p. 

(a) If A < Pq{R), then Z{R,A;P) is a real analytic function of P for P > Pq{R) 
such that its limit for P — /3q{R) — >■ +0 does not exist. 

The following thermodynamical analogies justify our interpretation of the asym- 
ptotic bound a phase transition curve. 

a) The argument f3 of the partition function corresponds to the inverse tempe- 
rature. 

b) The transmission rate R corresponds to the density p. 

c) Our asymptotic bound transported into (T = i?)-plane as T = l3q[R)~^ 
becomes the phase transition boundary in the (temperature, density)-plane. 

3. Zipf's law and Kolmogorov order 

3.1. Zipf's law. G. Zipf studied the frequencies with which words of a natural 
language are used in various texts. He found a remarkably stable pattern ([Zil], 
[Zi2]): if all words Wk of a language are ranked according to decreasing frequency 
of their appearance in a representative corpus of texts, then the frequency pk of 
Wk is approximately inversely proportional to its rank k: see e. g. Fig. 1 in [Mai] 
based upon a corpus containing 4 • 10^ Russian words. 

Zipf himself has suggested that this distribution "minimizes effort" . Mandelbrot 

in [Mand] has shown that if we postulate and denote by Ck a certain "cost" (of 
producing, using etc.) of the word of rank A;, then the frequency distribution 
Pk ~ 2"^^ minimizes the ratio h = C/H^ where C := '^^PkCk is the average 
cost per word, and H := — J2kPk^'^S2Pk is the average entropy: see [Ma2]. 

We get from this a power law, if Ck ~ log/c. An additional problem, what is so 
special about power —1, must be addressed separately. 

In all such discussions, it is more or less implicitly assumed that empirically 
observed distributions concern fragments of a potential countable infinity of objects. 
In the mathematical model suggested in [Man7] it is assumed that these objects 
form an infinite constructive world in the sense of 1.2 above. Below I will survey 
this model. 



10 



3.2. How minimization of complexity leads to Zipf 's law. A mathemat- 
ical model of Zipf 's law is based upon two postulates: 

(A) Rank ordering coincides with a Kolmogorov ordering (up to a factor exp (0(1)) ), 
cf. 1.3 above. 

(B) The probability distribution producing Zipf's law (with exponent —1) is (an 
approximation to) the L. Levin maximal computable from below distribution: see 
[ZvLe], [Levi], [Lev2] and [LiVi]. 

If we accept {A) and {B), then Zipf's law follows from two basic properties of 
Kolmogorov complexity: 

(a) rank of w defined according to (A) is exp (0(1)) ■ K{w). 

(b) Levin's distribution assigns to an object w probability ~ KP{w)~^ where KP 
is the exponentiated prefix Kolmogorov complexity (cf. [LiVi], [CaSt]), and we have, 
up to exp (0(1)) -factors, 

K(w) < KP(w) di K(w) ■ log^+^ K(w) 

with arbitrary £ > 0. 

There is a slight discrepancy between the growth orders of K and KP. This 
discrepancy ensures the convergence of the series KP{w)~^. On finite sets of 
data this small discrepancy is additionally masked by the dependence of both K 
and KP on the choice of an optimal encoding. 

"Minimization of effort" is thus achieved if effort itself is interpreted as the length 
of the maximally compressed prefix free description of an object. 

Such a picture makes sense especially if the objects satisfying Zipf's distribution, 
are generated rather than simply observed. 

This matches very well the results of the previous section on asymptotic bounds 
for error-correcting codes: if one produces codes in the order of their Kolmogorov 
complexity rather than size, their code points will well approximate the picture 
of the whole domain under the asymptotic bound. Moreover, Levin's distribution 
very naturally leads to the thermodynamic partition function on the set of codes, 
and to the interpretation of asymptotic bound as a phase transition curve. In sec. 
2, we have written it in the form the form Xlc -^(^)~**"^'' where s{C) is a cer- 
tain function defined on codes and including as parameters analogs of temperature 
and density. We could replace K with KP, and freely choose the optimal family 
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defining complexity: this would have no influence at all on the form of the phase 
curve/asymptotic bound. 

It is interesting to observe that the mathematical problem of generating good 
error-correcting codes historically made a great progress in the 1980's with the 
discovery of algebraic geometric Goppa codes, that is precisely with the discovery 
of greatly compressed descriptions of large combinatorial objects. 

To summarize, the class of a priori probability distributions that we are con- 
sidering here is qualitatively distinct from those that form now a common stock of 
sociological and sometimes scientific analysis: cf. a beautiful synopsis of the latter 
by Terence Tao in [Ta] who also stresses that "mathematicians do not have a fully 
satisfactory and convincing explanation for how the [Zipf] law comes about and 
why it is universal" . 

What arguments could furnish such an explanation? Ubiquity of Gaussian dis- 
tribution, for example, is often explained away by appealing to the central limit 
theorem: average of many independent random (equally distributed) variables tends 
to be Gaussian for whatever initial distribution. Below I will argue that universality 
of Zipf 's law is similarly based on the surprisingly self-similar nature of Kolmogorov 
complexity. 

3.3. Fractal landscape and self— similarity of the Kolmogorov complex- 
ity. In [LiVi], pp. 103, 105, 178, one can find a schematic graph of logarithmic 
complexity of naturals. The visible "continuity" of this graph reflects the fact that 
complexity of A; -|- 1 in any reasonable encoding is almost the same as complexity 
of k. It looks as follows: most of the time it follows closely the graph of log A;, but 
infinitely often it drops down, lower than any given computable function: 

One does not see or suspect self-similarity. But it is there: if one restricts this 
graph onto any infinite decidable subset of Z_|_ in increasing order, one will get the 
same complexity relief as for the whole Z+: in fact, for any recursive bijection / of 
Z+ with a subset of Z+ we have K{f{x)) = exp{0{l)) ■ K{x). 

If we pass from complexity to a Levin's distribution, that is, basically, invert the 
values of complexity, these fractal properties survive. 

This property can be read as the extreme stability of such a distribution with 

respect to the passage to various sub-universes of objects, computable renumber- 
ing of objects etc., in the same way as the picture of random noise in a stable 
background is held responsible for universality of normal distribution. 
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3.4. Complexity on the background of oracle assisted computations 
and library reuse. In the paper [Ve], T. Veldhuizen considers Zipf's law in an 
unusual context that did not exist in the days when Kolmogorov, Solomonov and 
Chaitin made their ground-breaking discoveries, but which provides, in a sense, 
landscape for an industrial incarnation of complexity. Namely, Veldhuizen studies 
actual software and software libraries and analyzes possible profits from software 
reuse. Metaphorically, this is a picture of human culture whose everyday existence 
depends on a continuous reuse of treasures created by researchers, poets, philoso- 
phers, cf. [Man6]. 

Mathematically, reuse furnishes new tools of compression: roughly speaking, a 
function / may have a very large Kolmogorov complexity, but the length of the 
library address of its program may be short, and only the latter counts if one can 
simply copy the program from the library. 

In order to create a mathematical model of reuse and its Zipf's landscape, the no- 
tion of an admissible set of partial functions note, I need to define the mathematical 
notion of relative Kolmogorov complexity K{f\^). 

3.5. Admissible sets of functions. Consider a set $ of partial functions 
/ : (Z^)"^ — )• (Z;|)", m,n > 0. We will call ^> an admissible set, if it is countable 
and satisfies the following conditions. 

(i) $ is closed under composition and contains all projections (forget some co- 
ordinates), and embeddings (permute and/or add some constant coordinates). 

Any (m + 1, n)-function can be considered as a family of (m, ?i)-functions (uk): 
Uk{xij . . . ,Xm) '■= u{xi, . . . ,Xrm k). From (i) it follows that for any u e $ and 
k e Z^, also Uk G Similarly, if u{xi, . . . , Xm) is in $, then 

U{Xl, . . . , Xffi, Xr/rfi^l, . . . , Xffi^Yi^ = ui^Xl, . . . , Xr/rfi) 

is in 

(a) For any (m, n), there exists such an {m+l,n) -function u E ^ that the family 
of functions Uk '■ (Z^)"* — >■ (Z^)"', contains all {m,n) -functions belonging to 

We will say that such a function u (or family {uj-) ) is ample. 

(Hi) Let f he a total recursive function f whose image is decidable, and f defines 
a bijection between D{f) and image of f . Then $ contains both f and f~^. 

It is shown in [Man7] that one can define analog of complexity with respect to 
such a set, K{x \ $) and, moreover, that such sets can be obtained as "algebras" 
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over a (pro)perad generated by standard operations that usually are applied only 
to partially recursive functions. 

There are many instances of empiric Zipf's laws where our picture might be 
applicable: cf. [Del], [DeMe], [De], [MurSo]. Such a reduction of the Zipf law for 
natural languages might require for its justification some neurobiological data: cf. 
[Mai] , appendix A in the arXiv version. 

4. Feynman graphs and perturbation series in quantum physics 
4.1. A toy model. Feynman path integral is an heuristic expression of the form 



(4.1) 



or, more generally, a similar heuristic expression for correlation functions. 

In the expression (4.1), V is imagined as a functional space of classical fields (/? on 
a space-time manifold M; S : "P — ?■ C is a functional of classical action measured 
in Planck's units. 5*0 is its quadratic part, or "free field action". 

Usually S{ip) itself is an integral over M of a local density on M called La- 
grangian. In our notation S{ip) = — Jj^ L{ip{x))dx. Lagrangian density may depend 
on derivatives, include distributions etc. 

Finally, the integration measure D{(^) and the integral itself Jj, should be con- 
sidered as symbolic constituents of the total expression (4.1) conveying a vague but 
powerful idea of "summing quantum amplitudes over virtual classical trajectories". 

In our toy model, we will replace "P by a finite-dimensional real space. We 
endow it with a basis indexed by a finite set of "colors" A, and an Euclidean metric 
g encoded by the symmetric tensor {g"'^), a,b e A. We put {g""^) = {gab)~^- 

The action functional S{(p) is a formal series in linear coordinates on P, (<^"), of 
the form 

S{<p) = So{<p) + S,{<p), So{<p) := -I J29ab<P''<p\ 

a.b 



oo ^ 

'^l(^)^=E^ E Ca,,...,a,^''^...^''^ (4.2) 
fc=l ai,...,OfcGj4 

where (C(ji,...,a„) arc certain symmetric tensors. 
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Below we will consider (gab) and (Coi,...,a„) as independent formal variables, 
"formal coordinates on the space of theories". 

We will express the toy version of (4.1) as a formal series over (isomorphism 
classes of) graphs. 

A (combinatorial) graph r, by definition, consists of two finite sets: flags Fj- and 
vertices Vr- Besides, an involution of F-j- is given, showing which pairs of flags 
form halves of edges, and which are not (tails). Finally, the map dr : F^- ^ Vr 
shows to which vertex each graph is incident. The geometric realization of r is 
a topological space whose structure is suggested by the choice of words in the 
definition: 




Each edge e consists of a pair of fiags denoted 9e, and each vertex v deter- 
mines the set of flags incident to it denoted Ft{v). By x(^) we denote the Euler 
characteristic of the geometric realization of r. 

4.2. Theorem. Let X be a formal parameter. Then 

/^eA-^o(.)i,(^) =E^"(") (4.3) 

where t runs over isomorphism classes of all finite graphs r. The weight w{t) of 
such a graph is determined by the action functional (1.2) as follows: 

^(^)^= E n ^'^^"'^ n cuiFAv))- (4.4) 

u-.Ft-^A eeEr veVr 
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More precisely, the identity (4.2) is obtained by first interpreting the integrands 
in the numerator of (4.2) as formal series in ((7a6, C'ai,...,afe), and then integrating 
term- wise by using the well known formulas for Gaussian integrals. 

5. Graphs as flowcharts, and Hopf algebras 

5.1. Graphs as flowcharts. Feynman diagrams of more realistic models and 
graphs used in the computation theory can be considered as flowcharts describing 
the flow of information from a part of tails playing role of inputs to another part, 
playing role of outputs. At vertices, the information gets processed. 

In order to make such an interpretation workable, we need pay more attention 
to orientation. Orientation of a graph r is the decoration F^- ^ Lp — {in, out} 
such that halves of any edge are decorated by different labels. 

Tails of T oriented in (resp. out) are called (global) inputs T^^ (resp. (global) 
outputs T°'^*) of r. Similarly, Friy) is partitioned into inputs and outputs of the 
vertex v. 

An oriented graph r is called directed if it satisfies the following condition: 

On each connected component one can define a continuous real valued function 
("time") in such a way that moving in the direction of orientation along each flag 
inreases the value of this function. 

In particular, oriented trees and forests are always directed, and physical Feyn- 
man diagrams without loops as well. 

An abstract flowchart is a directed graph endowed with the decoration of its 
vertices by a set Op of (names of) operations that can be performed on certain 
inputs producing certain outputs. Generally, flags are also labeled by types of the 
arguments. 

To be more precise, flowcharts in theoretical computer science form a natural 
hierarchy. 

At the lower level of this hierarchy, histories of computations are situated. For 
example, the sequence of the states of a Turing machine, performing a concrete 
computation, may be encoded by a flowchart, in which inputs of all vertices are 
decorated by or 1, and vertices themselves carry either the name of identical 
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operation or the name of the internal state of the head, reading the respective site. 
Such a history may well be infinite. 

At higher levels flowcharts may serve as descriptions: programs represented as 
compositions of some subprograms, but not specifying concrete values of arguments 
and thus hiding the actual computation process and/or compressing the notation. 

We omit here a formal definition of admissible sets of decorated fiowcharts: cf. 
[Man4], [Man5] for further details. Briefly, an admissible set must be closed wrt 
flnite disjoint unions and cuts that will be deflned below. 

For another version of flowcharts, see [Sc] . 

5.2. Connes— Kreimer bialgebras of flowcharts ([ConKr]). Let Fl be an 
admissible set of decorated graphs, k := a commutative ring. We denote hy H = 
Hpi the /c-linear span of isomorphism classes [r] of graphs r in Fl and deflne 
multiplication by 

m-.H^H^H, m([cT] ® [r]) := [ct]Jt], 

We pass now to cuts and comultiplication. 

Let T be an oriented graph. Call a proper cut C of t any partition of Vj- into 
a disjoint union of two non-empty subsets (upper vertices) and Vr^c (lower 
vertices) satisfying the following conditions: 

(i) For each oriented wheel in r, all its vertices belong either to , or to Vr^c- 

(ii) If an edge e connects a vertex vi G to V2 E Vr^c, then it is oriented from 
Vi to V2 ("information flows only from past to future" ). 

(iii) Two improper cuts: r*^ := r or rc = r. 

Denote by r'-" (resp. tc) the subgraphs of r consisting of vertices V^' (resp. 
Vr,c) and incident flags. Put 

A:H^H^H, A([t]) := J][T^](g)[Tc], 

c 

sum being taken over all cuts of r. 

Claim, (i) m defines on H the structure of a commutative k-algehra with unit 
[0]. Set r; : k^H,lk^ [0] . 
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(ii) A is a coassociative comultiplication on H, with counit 

e: H ^k, ^ a[^][T] a[0] 

(Hi) {H,m, AjSjr]) is a commutative bialgebra with unit and counit. 

5.2.1. Theorem. (K. Ebrahimi-Fard, D. Manchon, [E-FMan]). H is a Hopf 
algebra (i. e. has a unique antipode) if one can introduce an grading on H such 
that 

m{Hp ® Hq) C Hp+q, A{Hn) C ®p+q=nHp ® Hq, 

and moreover, Hq = k[0] is one-dimensional, so that H is connected. 
A possible choice of such grading: 

Hn '■= the k — suhmodule of H spanned by [r] in Fl with = n. 

6. Regular izat ion and renormalization 

6.1. Regular izat ion by "minimal subtraction". Generally, by regulariza- 
tion we mean "producing a finite answer from infinite one". A typical example is 
this. 

Consider the ring A ring of germs of meromorphic functions of 2 at 2: = 0. Put 
A- '.= z~'^C[z~^], and denote by Aj^ the ring of germs of regular functions at 
z — Q. The value of regular function at zero is £A{f) '■— /(O)- Any germ is unique 
sum of regular one and one belonging to A-. 

If a function is not necessarily regular, the regularized value of / at is = 
/+(0) where 

f+{z) := f{z) — {the polar part of /}. 

Generally, a "minimal subtraction algebra" is a commutative associative K- 
algebra A represented as the direct sum of two linear subspaces A = A+ © A- , 
each being a subalgebra. Usually A is unital and 1 & A; besides, we have an 
augmentation homomorphism : A+ -> K. 

6.2. Connes— Kreimer renormalization. This is a version of regularization 
that: 
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(i) is performed simultaneously for an infinite family of functions indexeded by 
flowcharts; 

(ii) uses the "division by the collective pole part" in a noncommutative group in 
place of subtraction of an individual pole. 

More precisely, consider a Hopf i^-algebra H, and a minimal subtraction unital 
algebra A- (Z A, e_A : A ^ K. 

Denote by G{A) the group of K-linear maps ip : % ^ A such that </'(1-h) = 
with the convolution product 

(f * il:{x) := mj\_{(f ® '0) A(a;) = (f{x) + il:{x) + Lp{x')il){x")' 
identity e{x) := o e{x), and inversion 

oo 

^*-\x) = e{x)+J2i^-^r^{x) 

m=l 

In situations that we will consider, for any x e kere the latter sum contains only 
finitely many non-zero summands. 

We will say that <^ is a character if it is a homomorphism of algebras. 

Following Birkhoff, we may define now "collective pole" and "collective regular 
part" of ip. More precisely, if ^ is a minimal subtraction algebra, each ip e G{A) 
admits a unique decomposition of the form 

(f = (p*s^ * (p_^- (p_(l) = 1^, (p_{keTs) C A-, (f+iH) C A+. 

Values of renormalized polar (resp. regular) parts (p- (resp. (p^) on kere are given 
by the inductive formulas 

(p-{x) = -TT (p{x) + ^(p-{x')(p{x") 



(p+ (x) = (id - tt) <p{x) + {x')<p{x") 





19 



Here tt : A- is the polar part projection in the algebra A. 

Physicists invented these inductive formulas: they are known as BPZH-renormalization, 
for Bogolyubov-Parasyuk-Zimmermann-Hepp. 

6.3. Deforming the Halting Problem. Let / be a partial recursive func- 
tion. The Halting Problem for / is that of recognizing whether a number k G Z_|_ 
belongs to its definition domain D{f). In this subsection, we will translate it into 
the problem, whether an analytic function /; z) of a complex parameter z has 
a pole at 2; = 1. 

The relevant minimal subtraction algebra will be a version of our example from 
6.1. 

Let A+ be the algebra of analytic functions in 1^1 < 1, continuous at \z\ = 1, 
EA : ^{z) ^ $(1). Put A- := (1 - z)-^C[{l - z)-^], A := A+ © A- 

We now choose an appropriate programming method P and construct its Hopf 
algebra. Basically, "H = "Hp is the symmetric algebra, spanned by isomorphism 
classes \p] of certain descriptions. Comultiplication in "Hp is dual to the composition 
of descriptions. 

The main choice is that of characters, corresponding to the halting problem. 

The character (pk '■ Hp ^ A corresponding to the halting problem at a point 

k e Z_(_ for the partial recursive function computable with the help of a description 
p e P{Z^, Z_|_), will be defined as (pkilp]) '■= ^{k, f;z)eA where the function $ is 
described below. 

Using the trick used in the theory of quantum computation (usually applied in 
the context of finite automata) we will first reduce the general halting problem to 
the recognition of fixed points of permutations. 

Start with a partial recursive function / : X ^ X, where X is a constructive 
world. Extend X by one point, i. e. form X]J{*x}- Choose a total recursive 
structure of an additive group without torsion on X with zero *x- Extend / 

to the everywhere defined function g : X Y[{*x} X W{*x}i by g{ii) :— *x if J/ ^ 
D{f). Define 

Tf : (x]J{*x})' ^ ■■= i^ + 9iy),y)- 

It is a permutation. Since (-^ll{*x}) +) has no torsion, the only finite orbits of 
are fixed points. 
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Moreover, the restriction of r/ upon the recursive enumerable subset D{af) := 
{X U{*^}) ^ ^if) induces a partial recursive permutation cr/ of this subset. Since 
g{y) never takes the zero value *x on y E D{f), but always is zero outside it, the 
complement to D{af) in Y consists entirely of fixed points of r/. 

Thus, the halting problem for / reduces to the fixed point recognition for r/. 

6.4. The Halting Problem renormalization character. Define a Kol- 
mogorov numbering on a constructive world X as a bijection K = K„ : X — )■ Z_|_ 
arranging elements of X in the increasing order of their complexities Ky^. 

Let a : X — > X be a partial recursive map, such that a maps D{a) to D{a) and 
induces a permutation of this set. Put ctk := K o cr o K"-*^ and consider this as a 
permutation of the subset 



consisting of numbers of elements of -D(cr) in the Kolmogorov order. 

If x G -D(cr) and if the orbit a'^{x) is infinite, then there exist such constants 
ci, C2 > that for k :— K.{x) and all n G Z we have 



Now let X — Z_|_ and let cr be a partial recursive map, inducing a permutation 
on its definition domain. Put 



Then we have: 

6.4.1. Theorem, (i) If a -orbit of x is finite, then ^{x,a;z) is a rational 
function in z whose all poles are of the first order and lie at roots of unity. 

(a) If this orbit is infinite, then ^{x,a;z) is the Taylor series of a function 
analytic at \z\ < 1 and continuous at the boundary \z\ = 1. 



D{aj^) K{D{a)) C Z+ 



ci •K(n) < a^{k) < C2 •K(n). 




REFERENCES 



[BoMan] D. Borisov, Yu. Manin. Generalized operads and their inner coho- 
momorhisms. In: Geometry and Dynamics of Groups and spaces (In memory of 



21 



Aleksander Reznikov). Ed. by M. Kapranov et al. Progress in Math., vol. 265. 
Birkhauscr, Boston, pp. 247-308. Preprint math.CT/0609748 

[CaSt] Ch. S. Calude, L. Staiger. On universal computably enumerable prefix 
codes. Math. Struct, in Comput. Sci. 19 (2009), no. 1, 45-57. 

[ConKr] A. Connes, D. Kreimer. Renormalization in quantum field theory and 
the Riemann-Hilbert problem. I. The Hopf algebra structure of graphs and the main 
theorem. Comm. Math. Phys. 210, no. 1 (2000), 249-273. 

[De] S. Dehaene. The Number Sense. How the Mind creates Mathematics. Ox- 
ford UP, 1997. 

[DeMe] S. Dehaene, J. Mehler. Cross-linguistic regularities in the frequency of 
number words. Cognition, 43 (1992), 1-29. 

[Del] J.-P. Delahaye. Les entiers ne naissent pas egaux. Pour la Science, no. 421, 
Nov. 2012, 80-85. 

[E-FMan] K. Ebrahimi-Fard and D. Manchon. The combinatorics of Bogolyubov's 
recursion in renormalization. math-ph/0710.3675 

[Levi] L. A. Levin, Various measures of complexity for finite objects (axiomatic 
description), Soviet Math. Dokl. Vol.17 (1976) N. 2, 522-526. 

[Lev2] L. A. Levin, Randomness conservation inequalities; information and inde- 
pendence in mathematical theories, Information and Control, Vol. 61 (1984) 15-37. 

[LiVi] Ming Li, P. Vitanyi. An introduction to Kolmogorov complexity and its 
applications. Springer, 1993. 

[Mand] B. Mandelbrot. An information theory of the statistical structure of lan- 
guages. In Communication Theory (ed. by W. Jackson, pp. 486-502, Butterworth, 
Woburn, MA, 1953. 

[Mai] D. Yu. Manin. Zipf's Law and Avoidance of Excessive Synonymy. Cogni- 
tive Science, vol. 32, issue 7 (2008), pp. 1075-1078. arXiv:0710.0105. 

[Ma2] D. Yu. Manin. Mandelbrot's model for Zipf's Law. Can Mandelbrot's 
model explain Zipf's Law for language? Journ. of Quantitative Linguistics, vol.16. 
No. 3 (2009), 274-285. 

[Manl] Yu. I. Manin. A Course in Mathematical Logic for Mathematicians. 
Second Edition. Graduate Texts in Mathematics, Springer Verlag, 2010. 

[Man2] Yu. Manin. A computability challenge: asymptotic bounds and isolated 
error- correcting codes. In: WTCS 2012 (Calude Festschrift), Ed. by M.J. Dinneen 
et al., LNCS 7160, pp. 174182, 2012. Preprint arXiv: 1107.4246 



22 



[Man3] Yu. Manin. Classical computing, quantum computing, and Shor's factor- 
ing algorithm. Seminaire Bourbaki, no. 862 (June 1999), Asterisque, vol 266, 2000, 
375-404. quant-ph/9903008. 

[Man4] Yu. Manin. Renormalization and computation I. Motivation and hack- 
ground. In: Proceedings OPERADS 2009, eds. J. Loday and B. Vallette, Seminaires 
et Congres 26, Soc. Math, de France, 2012, pp. 181-223. math.QA/0904.492 

[Man5] Yu. Manin. Renormalization and computation II: Time cut-off and the 
Halting Problem. In: Math. Struct, in Comp. Science, vol. 22, Special issue, pp. 
729-751, 2012, Cambridge UP. math.QA/0908.3430 

[Man6] Yu. Manin. Kolmogorov complexity as a hidden factor of scientific dis- 
course: from Newton's law to data mining. Talk at the Plenary Session of the 
Pontifical Academy of Sciences on "Complexity and Analogy in Science: Theoret- 
ical, Methodological and Epistemological Aspects", Vatican, November 5-7, 2012. 
arXiv:1301.0081 

[Man7] Yu. Manin. Zipf's law and L. Levin's probability distributions. Preprint 
arXiv:1301.0427 

[ManMar] Yu. Manin, M. MarcoUi. Kolmogorov complexity and the asymptotic 
bound for error- correcting codes. Preprint arXiv:1203.0653 

[MurSo] B. C. Murtra, R. Sole. On the Universality of Zipf's Law. (2010), Santa 
Fe Institute. (^a?;az/a6/e online). 

[Sc] D. Scott. The lattice of flow diagrams. In: Symposium on Semantics of 
Algorithmic Languages, Springer LN of Mathematics, 188 (1971), 311-372. 

[Ta] T. Tao. E pluribus unum: Prom Complexity, Universality. Daedalus, Journ. 
of the AAAS, Summer 2012, 23-34. 

[Ve] Todd L. Veldhuizen. Software Libraries and Their Reuse: Entropy, Kol- 
mogorov Complexity, and Zipf's Law. arXiv:cs/0508023 

[VlaNoTsfa] S. G. Vladut, D. Yu. Nogin, M. A. Tsfasman. Algebraic geomet- 
ric codes: basic notions. Mathematical Surveys and Monographs, 139. American 
Mathematical Society, Providence, RI, 2007. 

[Ya] N. S. Yanofsky. Towards a definition of an algorithm. J. Logic Comput. 21 
(2011), no. 2, 253-286. math.LO/0602053 

[Zil] G. K. Zipf. The psycho-biology of language. London, Routledge, 1936. 

[Zi2] G. K. Zipf. Human behavior and the principle of least effort. Addison- 
Wesley, 1949. 



23 



[ZvLe] A. K. Zvonkin, L. A. Levin. The complexity of finite objects and the 
basing of the concepts of information and randomness on the theory of algorithms. 
(Russian) Uspehi Mat. Nauk 25, no. 6(156) (1970), 8-127. 



